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Abstract 


Pairwise comparisons between alternatives are a well-established tool to decompose decision problems into smaller 
and more easily tractable sub-problems. However, due to our limited rationality, the subjective preferences ex¬ 
pressed by decision makers over pairs of alternatives can hardly ever be consistent. Therefore, several inconsistency 
indices have been proposed in the literature to quantify the extent of the deviation from complete consistency. 
Only recently, a set of properties has been proposed to define a family of functions representing inconsistency 
indices. The scope of this paper is twofold. Firstly, it expands the set of properties by adding and justifying a 
new one. Secondly, it continues the study of inconsistency indices to check whether or not they satisfy the above 
mentioned properties. Out of the four indices considered in this paper, in its present form, two fail to satisfy some 
properties. An adjusted version of one index is proposed so that it fulfills them. 

Keywords: pairwise comparisons, consistency, inconsistency indices, analytic hierarchy process. 


In decision making problems it is often common practice to use pairwise comparisons between alter¬ 
natives as a basis to assign scores to the same alternatives. Pairwise comparisons allow the decision 
maker to decompose the problem of assigning scores to alternatives into smaller problems, where only 
two alternatives are considered at a time. 


Another reason for using pairwise comparisons is that their use allows an estimation of the inconsistency 
of the preferences of a decision maker. In the literature, consistency of preferences is commonly related 
with the rationality of a decision maker and his ability in discriminating between alternatives ( Irwin . 


1958). Consider, for sake of illustration, three stones (alternatives) xi,X 2 ,x%. If, for instance, x\ is 


reputed twice as heavy as X 2 , and X 2 twice as heavy as * 3 , then it is reasonable to assume that x\ should 
be four times as heavy as X 3 . This situation is called consistent, as the pairwise comparisons of the 
decision maker respect a principle of transitivity/rationality, and is depicted in Figure [Ha). An example 
of inconsistent pairwise comparisons is illustrated in Figure [U(b). 

There is a meeting of minds on accepting preferences which are not consistent, but not too inconsistent 
either. In this paper, with the term i nconsis t ency we mean a deviation from the condition of full 
consistency. In the theory of the AHP, ISaatvl (I1993I. 120131) r e quired pairwise compa risons to be near 
consistent, i.e. not too inconsistent. As recalled by Gass (2005), Luce and Raiffa (1957) shared the same 
opinion in accepting inconsistencies and wrote “No matter how intransitivities arise, we must recognize 
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(a) Consistent triad of (b) Inconsistent triad 

pairwise compar- of pairwise compar¬ 
isons. isons. 


Figure 1: Example of consistent and inconsistent triads of pairwise comparisons on xx,X 2 ,xz. 


that they exist, and we can take a little comfort in the thought that they are an anathem a to most of 
what constitutes theory in the behavioral sciences today”. On a similar note, Fishburn (1999) wrote 
that “Transitivity is obviously a great practical convenience and a nice thing to have for mathematical 
purposes, but long ago this author ceased to understand why it should be a cornerstone of normative 
decision theory”. 

It is in this context—where consistency is an auspicable but hardly ever achievable condition—that it 
becomes crucial to quantify inconsistency. Such quantification is indeed possible, since it is natural to 
envision that the notion of inconsistency is a matter or degree. Consequently, a wealth of inconsistency in¬ 
dices has been pro posed in the literature; for instance the Consistency Index (Saaty, 201 3), the Harmonic 
Cons istency Index (|Stein and Mizzil. 120071). the Geometric Consist ency Index (lAguaron and Moreno-Jimenea . 
2003 ). the statistical index by Lin et al. ( 2013 ). and the index by Kulakowski ( 20 id ), iust to cite few. 


It is worth noting that the study of inconsistency of preferences is not limited to the single mathe¬ 
matical methods employing pairwise comparisons, as for instance the AHP. It is the case to remark that 
the study of inconsistency is immune from many of the criticisms moved against specific mathematical 
methods employing them. For instance, one of the criti cal points of the_ Analytic Hierarchy Process 
(AHP) is the rank rever sal, which was disco vered by [B elton and Gear (1983) and recently surveyed by 


Maleki and Zahiii 1)20131 ) . Similarly, already IWatson and Freelind (119821 . [1983) questioned the interpre¬ 


tation of the weights in the AHP and their use in the aggregation of different priority vectors. In part, 
also the criticisms by Dver dl990al lbl) were triggered by the interpretation of the weights. Nevertheless, 
even though the above mentioned criticisms are to be taken into account, they are connected with the 
aggregation and interpretation of priority vectors proposed for the AHP, and therefore they will not 
affect the subject matter of inconsistency evaluation. Further support to the use of pairwise comparison 
matrices and their interpretation co mes f rom the fact that p airwise comparison matrices as defined in 
this paper are group isomorphic ( Cavallo and D’A puzzol, 2009|) - —and thus structurally identical—to the 
probabilistic preference relations studied by Luce and Suppesl ( 1965 ). Such a strict connection between 
these two representations of valued preferences does not only make them mutually supportive, but in¬ 
creases the relevance of studying one of them—as it is going to be done in this paper—since abstract 
results are then extendible to the other one. 

The use of the notion of inconsistency has gone beyond its mere quantification. One prominent use 
of inconsistency in dices is that of localizing the inconsistency and detect what comparisons are the 
most contradictory (lErgu et al.l. l201ll) and guid e the decision maker when he tries t o obtain sufficien tly 
consistent preferences (jPereira and Costal . 120151 ) . This process was also advocated by iFishburnl (|l968l ) in 
a discussion on decision theory: “If the individual’s preferences appear to violate a “rational” preference 
assumption, the theory suggests that he reexamine and revise one or more preference judgments to 
eliminate the inconsistency.”. Another use of inconsistency indices regards pairwise comparison matrices 
with missing entries. In these situations, inconsistency indices have been used as objective functions to be 
minimized to find the most plausible values of the missing comparisons with respect to th e elicited ones 
(IKoczkodai et all Il999l : lLamata and Pelaea . 120021 : IShiraishi et all Il999l : IChen et all 120151 ) . All this can 
be seen as evidence on the role played by inconsistency indices in the decision process, and consequently 
on the importance of having realiable indices. 

Inconsistency of preferences has been studied empirically fBozoki et al 2013), and existing studies on 
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the concept of inconsistency index and then tested on some well-known indices. 


In the pursuit of a formal treatment of inconsistency quantification, this paper presents some de¬ 
velopments concerning the aforementioned set of properties. Firstly, in Section [2J a new property, of 
invariance under inversion of preferences, is introduced and its role is discussed. Secondly, Section [3] 
contains further results on the satisfaction of the properties by some known inconsistency indices. More 
specifically, we shall study four indices and discover that, in its present form, two do not fully satisfy the 
set of properties. An adjustment of one index is then proposed so that it satisfies them. Finally, Section 
3 ] offers a concise discussion on the role of inconsistency quantification and on the results obtained in 
this paper. 


1 Pairwise comparison matrices and inconsistency indices 


Given a set X = {aq,..., x n } of n alternatives, a pairwise comparison matrix is a positive square matrix 
A = ( aij) nxn such that a^aji = 1, where aq > 0 is the subjective assessment of the relative importance of 
the zth alternative with respect to the jth one. A pairwise comparison matrix can be seen as a convenient 
mathematical structure into which valued pairwise comparisons between alternatives are collected. Its 
general and its simplified (thanks to aqOjj = 1) forms are the following, 
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The rest of the paper will follow the usual interpretation of entries aij in terms of ratios between quantities 
expressible on a ratio scale with a zero element. The classical example is that of aq and aq being stones 
and aij being the numerical estimation of the ratio between their weights. Note that this approach 
considers entries an > 0 taking va l ues fro m an unbounded scale and complies with the formal treatment 
given by iHerman and Koczkodail (|l99fSl ) and iKoczkodai and Szward (| 20 141 ). Furthermore, with this 
interpretation, a pairwise comparison matrix is consistent if and only if 


Ojfc Q’ij&jk (1) 

which means that each direct comparison ajfc is exactly backed up by all indirect comparisons a^ajk Vj. 
For notational convenience, the set of all pairwise comparison matrices is defined as 


A — {A — {a>ij')ny.n\Q j ij ^ 0; — 1 Vi, j 1 n 2} . 

The set of all consistent pairwise comparison matrices A* C A is defined accordingly, 

A — {A — (dij)nxn|A £ A, Cljfc — ttijOjk Vi,jA}. 

An inconsistency index is a function I : A —> R which evaluates the intensity of deviation of a pairwise 
comparison matrix A from its consistent form (jT]) . In other words, the value /(A) is an estimation of 
how much irrational the preferences collected in A are. Up to now, various inconsistency indices have 
been introduced heuristically, and an open question relates to what set of properties should be used 
to characterize them. That is, all the reasonable properties for a function I to fairly capture inconsis¬ 
tency could be used for various purposes; for example to check the validity of already proposed indices 
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Figure 2: The set of properties can be used to define a family of functions which can be used to estimate 
inconsistency, and discards functions which do not make sense if used as inconsistency indices, 
e.g. the trace and the determinant of A. 


(Bru nelli and Fedrizzil . l2015al h devise new ones, and derive further properties (jBrunelli and Fedrizzil . 
2015b). Figure [2] offers a snapshot of the meaning of the set of properties. 


Brunelli and Fedrizzi (2015a) proposed five properties to characterize inconsistency indices. Since these 
properties were already justified and defined in the original work, they are here only briefly recalled. 
Note that they were organized in the form of an axiomatic systems, meaning that the soundness of single 
properties implies the soundness of the entire set of properties, i.e. the “logical intersection” of the 
properties. 

PI: There exists a unique representing the situation of full consistency, i.e. 


3\v e M such that /(A) = v A € A* 


P2: Changing the order of the alternatives does not affect the inconsistency of preferences. That is, 

7(PAP t ) = 1(A), 


for any permutation matrix P. 

P3: If preferences in A are intensified, then the inconsistency cannot decrease. More formally, since the 
power is the only meaningful function to intensify preferences, we defined A (b) = (o/ ? I . Then, 
the property is as follows, 

I(A(b)) > 1(A) VA e A, b> 1. 


P4: Given a consistent pairwise comparison matrix and considering an arbitrary non-diagonal element 
a pq (and its reciprocal a qp ) such that a pq A 1; then, as we push its value far from its original 
one, the inconsistency of the matrix should not decrease. More formally, given a consistent matrix 
A £ T, let A pq (6) be the inconsistent matrix obtained from A by replacing the entry a pq with 
a pq , where 5 A 1- Necessarily, a qp must be replaced by a qp in order to preserve reciprocity. Let 
A pq (5') be the inconsistent matrix obtained from A by replacing entries a pq and a qp with a pq and 
a qp respectively. The property can then be formulated as 


<5' > <5 > 1 =* I(A pq (5')) > I(A pq (S)) 
6'<5< 1 =* I(A pq (5')) > I(A pq (6)), 

for all S A 1, Vi Q = 1, ■ ■ •, n, an d A € A*. 

P5: Function I is continuous with respect to the entries of A. 


( 2 ) 


2 A new property of invariance under inversion of preferences 

Preferences expressed in the form of a pairwise comparison matrix A can be inverted by taking its 
transpose A 1 . For instance, if a t j = 2 in A is inverted into a t] = 1/2 we have that the intensity 
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of preference is the same, but the direction is inverted. Clearly, by inverting all the preferences we 
change their polarity, but leave their structure unchanged. Thus, it is reasonable to expect a structural 
property of preferences—as inconsistency is—to be invariant under inversion. This can be formalized in 
the following property of invariance under inversion of preferences (P6). 

Property 6 (P6). An inconsistency index satisfies P6, if and only if 1(A) = /(A 7 ) VA € A. 


The previous justification of this property can be transposed into an example. Consider the following 
matrix A and its transpose A T . 

l\ 1/2 l/4\ / 1 2 4\ 

A = | 2 1 1/3 ] A t = I 1/2 1 3 (3) 

\4 3 1 J \l/4 1/3 1 J 

One can equivalently express the structure of the preferences by means of directed weighted graphs with 
nodes Xi and values of the edges aij. Figure 0 represents these graphs for A and A 7 , respectively. 




Figure 3: Graphs of A and A 7 . 


The two graphs are identical, with the only exception of the directions of the arrows. Now, if we do not 
impose P6, we might end up with inconsistency indices which consider the violation of the condition of 
consistency in the direction 1 —> 2 —>• 3 —> 1 more or less (but not equally) important than the violation 
in the direction 1 —> 3 —> 2 —>• 1, although both directions equivalently reflect the same structure of 
preferences. 


The justification of P6 comes from theoretical intuition, but in some decision processes both a matrix 
A ad its transpose A 7 can actually appear. Examples are applications in group decision making where 
pairwise compari son matrices are used i n sur veys on cust o mers’ needs and users’ satisfactions, as for 
instance done by iNikou and Mezeil (120131 1 and iNikou et al.1 (120151 1 . In these contexts there are as many 
pairwise comparison matrices as responding customers (usually a large number) and therefore it is not 
completely unlikely to find both preferences represented by A and A 7 , especially when there are few 
alternatives and intensities of preference are weak. i.e., values of entries are close to 1. 


Note that, in general, an inversion of preferences cannot be obtained by row-column permutations. 
For example, given the matrices A and A 7 in ([3]), there does not exist a permutation matrix P such 
that PAP t = A t . 


One natural question is whether or not this new property, P6, is implied by a conjoint application of 
the others (independence) and if, when added to the set P1-P5, does not make it contradictory (logical 
consistency). The following theorem claims the independence and the logical consistency of the properties 
P1-P6. 


Theorem 1. Properties P1-P6 are independent and form a logically consistent axiomatic system. 


Proof. See Appendix. □ 

In light of the previously offered justification and Theorem [1] one concludes that P6 is another inter¬ 
esting property of inconsistency indices, and is independent from P1-P5. 
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3 Extending the analysis of the satisfaction of the axioms 


Previous research (jBrunelli and Fedrizzil . l2015al : ICavallo and D’ApuzzoI . 120121 ) has made the effort of 
proving whether or not some known inconsistency indices satisfy the set of properties. This section 
continues the investigation on the satisfaction of the set of properties by testing four indices proposed 
in the literature and used in real-world decision making problems. For each index we shall recall the 
definition and highlight its relevance in both theory and practice. 


3.1 Index K by Koczkodaj 


The f ollowing index, K, was introduced bv iKoczkodail ([1993) and extended bv iDuszak and Koczkodai 
dl994lf . 


Definition 1 (Index K (Duszak and Koczkodaj, 1991)). Given a pairwise comparison matrix A, the 
index K is 


K( A) = max < min 


1 - 


O'ik 


&ij k 


1 - 


Mj k 


^ik 


: 1 <i<j<k<n 


( 4 ) 


This index has been used to estimate missing entries of incomplete pairwise comparisons (Koczkodaj _et al 


1999) and in real-world a pplications in problems s uch as the evaluati o n of r esearch institutions in Poland 


S aaty’s Consistency Index (IBozoki and Rapcsak 


(IKoczkodai et all 12014 ) an d medical diagnosis ( Kakiashvili et all l2012l ). It was also compared to 


2008! ) and on occasions even claimed superior to it 


( Koczkodaj and Szwarc, 2014h . Given its theoretical and practical relevance, it is therefore important to 
check what properties it satisfies. Here we show that index K satisfies the six properties P1-P6. 

Proposition 1. Index K satisfies the properties P1-P6. 


Proof. It is straightforward, and thus omitted, to show that properties PI, P2, P5, and P6 are satisfied. 
For P3 we need to show that the local inconsistency for the generic transitivity ( i,j,k ), 
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( 5 ) 


is non-decreasing for b > 1. We can do it by proving that ^ > 0 V6 > 1. With x b := ' b , we study 
the two quantities 




I = II -x 6 


II = |1 -x 


-b | 


If the triple (■ i,j,k ) is consistent, then x = 1 and P3 is satisfied. If the triple ( i,j,k ) is not consistent, 
then i / 1 and positive, and the derivatives of I and II in b are: 

d\. 

— = -x h log(x)sgn (l - a/) 

= X~ b log(x)sgn (l - x~ b 

Given b > 1, if x 1, then ^ and ^ are positive, which proves that Q is a non-decreasing function 
for b > 1. It follows that also K is a non-decreasing function of 6 > 1. 

To prove the satisfaction of P4 we start considering 
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with aik = aijOjk■ By setting y = = a^ajk we can rewrite it as 
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and show that it is a non-decreasing function for b > 1 and a non-increasing function for 0 < b < 1. We 
then need to study the following quantities: 

I = 11 — y 5 ~ 1 \ 11= |l-y 1_5 | 


and their derivatives in 5 

= - V 5-1 log(y)sgn (l - y 5-1 ) ^ = y 1-5 log(y)sgn (l - y 1-5 ) . 

By studying their sign we can derive that 


<91 <911 dK 

0 < <5 < 1 => —, — < 0 => < 0 

do do do 

e dl <911 dK 


Similarly, P4 can be proven also in the case when the exponent <5 is at the denominator of 


1>ij Q>j k 


m 

□ 


3.2 Index AI by Salo and Hamalainen 


Salo and Hamalainen (1995|, 1997) proposed their inconsistency index, AI, which stands for ambiguity 


index. Their incons iste ncy index ha s bee n implemented in the online decision making platform Web- 
HIPRE (jMustaioki and Hamalainenl . 12001)1 1 and has been use d, for instance, in the analysi s of a real-world 
governme ntal decision on energy productio n alternatives (I Salo and Hamalainenl . 119951 ) and in traffic 
planning ([Hamalainen a nd Povlionenl . 19961). 


Definition 2. Given a pairwise comparison matrix A and an auxiliary matrix R = (r^) nxn with rij = 
{aikdkj\k = 1,... ,n}, then the index AI is 


AI( A) 


2 

n(n — 1) 


71—1 71 


EE 

1=1 j=i +1 


max(rjj) — min(rjj) 

(1 + max(r-y))(l + min(rjj)) 


( 7 ) 


The interpretation of AI is original and different from those of other indices. Consider that is not a 
real number but, instead, the set of possible values of a Vj as could be deduced from indirect comparisons 
Q'ikQ’kj V/c. 

For example, given the matrix 

/ 1 2 3 l/2\ 

1/2 1 4 1/3 

1/3 1/4 1 2 ’ 

y 2 3 1/2 1/ 


we have 


r i 4 — { 011014 ,^ 12024 , 013034 , 014044 } 



from which we obtain max(ri 4 ) = 6 and min(ri 4 ) = 1 / 2 . 
It is possible to build an interval-valued matrix 


A = (oii)„xn = ([mm(r i j),max(r ii )]) nxn 

such that the ‘true value’ of the comparison between Xj and Xj shall lie in the interval dij. The larger 
the intervals are, the more inconsistent the matrix, and in fact AI is a normalized sum of the lengths of 
the intervals dij. The following shows that AI satisfies all properties except P3. 

Proposition 2. Index AI satisfies PI, P2 and P^-P6, but not P3. 
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Proof. We shall prove all the properties separately. 

PI : Assuming v = 0, then we should prove AI( A) = 0 A G A*. 

(=►): As all the terms of the sum in ([7D are non-negative, if AI( A) = 0, then they must all 
be equal to zero. Such terms equal zero only when all the numerators equal zero, i.e. when 
max(rjj) = min(rjj) Vi < j, which implies that A G A*. 

(<^=): If A G A*, then all the elements rij are singletons and therefore max(rjj) = min(r,j) Vi < j, 
implying that the numerators in d7j) equals zero and AI( A) = 0 
P2 : Straightforward. 

P3 : It is sufficient to consider the following matrix A and its derived A(2) and A(3) 
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and observe that /(A(2)) ~ 0.108 and I(A(3)) « 0.068. Hence /(A(2)) > I(A(3)) and P3 is not 
satisfied. 


P4 : Given ai 2 , 023 ,..., a n _i n , a consistent pairwise comparison matrix of order n can be equivalently 
written as 
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or, more compactly, as B = ( bij) nxn where 


bij — < 


f uU a pp+ ii < j 

1, Vi = j 

_ V Ylp=i a pp+ 1) ^ > j 

Then, each element of the auxiliary matrix R is as follows 


(9) 


rij = {b ik b k j\k = 1,... ,n} Vi, j. 

Now, to test P4, without loss of generality, we fix the pair (l,n) and replace a\ n and a n i with a L 
and a s nX , respectively. Consequently, b\ n and b n \ are replaced by bf n and b & nl . Hence, for all i < j 


’ 13 


{bij}, Vi,j^{l,n} 

, otherwise. 


Considering the definition of AI we reckon that the terms associated with rij for i,j cf {1, n} equals 
zero. Therefore, we shall prove that all the other terms are non-decreasing functions of 5. We can 
rewrite 

and with x := b^, y := b\ n , fi = 5 — 1, it boils down to prove that 


ma x{x,xy^} — min{x, xy^} 

(1 + max{x, xy^}){\ + min{x,x?/^}) 


( 10 ) 


is a non-decreasing function of y > 0 when also x, y > 0. Now we should examine the two cases (i) 
x < xy ^ and (ii) x > We start with x < xy M and, considering that 


>x^y^>l^y>\ 


















and that therefore, for the case xz > x, y M is always an increasing function of y. Hence, we can 
substitute with z > 1 and m can be replaced by 


max{x, xz} — min{x, xz} 

(1 + max{x, xz})( 1 + min{x, xz}) 


(x > 0, z > 1). 


Considering that we are in the case with xy > x, we simplify m, and obtain 

xz — x 

^ (1 + xz)( 1 + x)' 


( 11 ) 


( 12 ) 


So now we shall prove that 


dz 


is positive for all x > 0, z > 1. 


x x{xz — x) 

dz (l + x)(l + xz) (1 + x){l + xz) 2 
x(l + xz) — x(xz — x) 

(1 + x){l + xz) 2 
x(l + x) 

(1 + x)(l + xz) 2 

X 

(1 + xz) 2 ' 

This last quantity is always positive for x > 0. A very similar result can be derived for the case 
(ii) x > xy and thus AI satisfies P4. 

It can be checked that AI also satisfies properties P5 and P6. □ 


Although in its present form index AI does not satisfy P3, the underlying idea is ingenious and it is 
sufficient to adjust it, i.e. discard the normalization at the denominator, to make it satisfy P3. 

Proposition 3. The inconsistency index 

1 n n 

AT (A) = wEE (max(rjj) — min(rjj)) 

1 ~ ’ i =l j =l 

satisfies properties P1-P6. 


Proof. It follows from the proof of Proposition [2] that AI* satisfies PI, P2, P4, P5, and P6. To show 
that P3 is satisfied, it is sufficient to take the arguments of the sum Ya =i X)j =i ( max ( r ij) — min(rjj)) 
and consider that they are all non-negative, since max(r^) > min(rjj) Vz, j. Consequently, the terms 
(ma x(rij) b — min(rjj) b ) > 0 are monotone non-decreasing functions with respect to b > 1, and P3 is 
satisfied. □ 

Example 1. Consider the pairwise comparison matrix A in ([8]) and its associated A(6) = (®ij^ 
Figured] contains the plots of AI and AI* for A(6) as functions of b and shows their different behaviors. 


3.3 Index by Wu and Xu 


Wu and Xu (2012j) defined their inconsistency index using some properties of the Hadamard product of 


positive matrices. 


Definition 3 (Index by Wu and Xu (2012)). The index defined by Wu and Xu is 


CI H ( A) = a ij9ji > 


t= 1 j= 1 


where gij = (IlLLi aifcOfcj)’ 
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(a) Index AI can be decreasing w.r.t b, and even tend 
to 0, when b —> oo. 


(b) Index AI* is monotone non-decreasing w.r.t. b. 


Figure 4: Comparison between AI and AI* with respect to P3. 


Note that the matrix G = ( 9ij) nxn *= -4* can be interpreted as a consistent approximation of A. In 
the original paper CIh was used in a mathematical model to manage consistency and consensus at once. 
Until now, no formal or numerical analysis has been made on CIh and there is no information on its 
properties. However, with the following proposition we show that it satisfies P1-P6. 

Proposition 4. Index CIh satisfies the properties PI P6. 


Proof. We shall show that PI is satisfied, with u = 1. First we need to prove that CIh{ A) = l=)>Ae A* 

n—1 n 


CI H (A) = n 2 'Yh - n + n 2 


i=l j=l 


1=1 j=i-\-1 


&ij 9 j i "P 
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di 


■ijdji 


1 9ji ) 


Now it can be seen that each function if(aij,gji ) attains its global minimum, equal to 2, when aijgji = 1, 
which is a restatement of the consistency condition. In this case, to receive the hint that u = 1, it is 
enough to simplify the sum, 

c/„ ( A) = 1 + P'ir f, 2 = 1 + P.d!mh. 2 = i 

n n z z —' z —' n n z z 

i= 1 j=i-\-l 

Now in the other direction, A € A* =>■ CIh (A) = 1, it suffices to expand CIh( A) 


n n n / 

CI H (A) = v EE b 

*=u=i \ 
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n O-ik^kj 


l/n\ 


Since consistency implies a^a^j = a^- we have 

n n / -\ \ -t 71 n 

CI H (A) = iEE her) = = 


i=l j=1 


Q*ij / ^ 

J i=l j=l 


It is simple, and thus omitted, to show that P2, P5 and P6 hold. To prove P3, we shall call (ag)ij = a ij9ji- 


By expanding g jU 


bibb b b b b \ b 

{ a d)ij = a ij (^ a jl a li ' a j2 a 2i ' • ■ ■ ' a jn a niJ = ( a ij9ji ) 

Since ( ag)ij = 1 /(ag)ji, by summing (ag)ij and (ag)ji we obtain 


>o 


iA9)ij A { a d)ji — ( Aij9ji ) ~b 


((J'ij 9ji) 


Vi, 3, 
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which is an increasing function for b > 0. Since this holds for the general pair of indices the index 

satisfies P3. 

To prove P4, assume, without loss of generality, that the element to be modified is ai n . For sake of 
simplicity, we can modify it and its reciprocal by multiplying them by f3 > 0. All the (ag)jj with 
i, j (ji {l,n} will be equal to 1. For the entries with one index i,j equal to either 1 or n we have 

• • • &jnQ"rii P) ^ i 


meaning that gji = a,jif3 1 l n . As we know that g^ = 1/gji, by summing (ag)ij and ( ag)ji and simplifying, 
one obtains 

1 + R 1 / 71 

pl/ n + P ’ 

which is a strictly convex function for /3 > 0 with minimum in /3 = 1. Similarly, for (ag)\ n and (ag) n i, 
it is 

(ag)in + (ag) n i = + P 2 ^ n , 

which shares the same property. □ 


3.4 Cosine Consistency Index and other indices 

Many times it is not easy to prove whether an index satisfies some properties, but numerical tests and 
counterexamples can always be used to show that the index does not. This was the case with the Cosine 
Consistency Index. 


Definition 4 (Cosine Consistency Index (|Kou and Liu, 2014)). The Cosine Consistency Index is 

CCI{ A) = 


\ 



where bij = a^j\jYJk=i a , 


2 

kj- 


Note that CCI{ A) € [0,1] and its interpretation is reversed, meaning that the greater its value the 
less inconsistent A is. It is simple, and it can also be found in the original paper, to show that CCI 
satisfies PI, P2, P5, and P6. For insta nce, in the case of PI, the proof comes directly from Equation 6 
and Theorem 3 in the paper by Kou and Liu (201J). However, the following counterexample suffices to 
show that CCI does not satisfy P3. 


Example 2. Consider the matrix 



(13) 


and its associated A (b) = ( a\ 
does not satisfy P3. 


— f„b ) 
ij) 


The plot of CCI(A(b)) is reported in Figure [5] and shows that CCI 


Often, although in their present forms they do not satisfy P1-P6, ideas behind indices are valid and 
slight modificatio ns are sufficient to make t hem satisfy a set of pro perties. One ex ample is the index 
JVZ n proposed bv lRamfk and Korvinv (2010) wh ich w as later studied (IBrunellil . l201lh . Another concrete 
example is the Relative Error index by|Barzilai (j19981 ) which does not satisfy P4 and P5. In its original 
formulation such index is 

£?=i £?=i (Pij -<U + djf 


RE (A) = 


E n \~^n / 

i= 1 £?=1 IP 


VJ 
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CCI(A(b)) 



Figure 5: For the matrix A in (1131) . an intensification of preferences decreases the inconsistency. 

where pij = log a^- and d t = ^ Ylk= i Pik ■ and where the denominator acts as a normalization factor. Here 
it can be proved that, if we discard the denominator, we obtain 


RE*(A) = ^ ^ (pij — di + dj) 2 , 

*=i i= i 

which, unlike RR, satisfies all the properties. 

Proposition 5. Index RE* satisfies all the properties P1-P6. 

Proof. It is easy to show, and therefore omitted, that PI, P2, P5 and P6 are satisfied. We shall prove 


P3 and P4 separately. To prove the satisfaction of P3 we consider A(b) = ( off ) and note that applying 


the logarithmic transformation to its entries, we obtain (61ogajj) = (pij ■ b) 


Hence, 


n n / 1 n i n \ Z 

RE*(A(b)) = EE b • Pij - - b-pjk) =b 2 -RE*( A), 

i= 1 j =1 V fe=l fc=l / 

which implies that RE*(A(b)) is monotone non-decreasing for b > 1. 

To show that P4 holds, let us consider the matrix A € A*, and its associated P = ( Pij) n xn = (log a,ij) nxn . 
P4 can equivalently be restated as the property that, if we take an entry p pq and its reciprocal p qp and 
substitute them with p pq + £ and p qp — £, respectively, then the inconsistency index RE* is apuasi-convex 
function of £ with minimum in £ = 0. From the proof of Proposition 5 in (Brunelli and Fedrizzi, 2015a|) 
one recovers that, by introducing £, it is 


EEfej- (| . + (i j) 2 = 4 ( n - 2 )H + 2 (^c 

i —1 j=l \ / \ 


Thus one obtains, 


RE*( A pq {0) = 4(n - 2) ( i) +2 (—f) ' = 2( 2 + ^ = £ 2 

' n) \ n / n n 


>o 


which is a decreasing function of £ for £ < 0 and an increasing function for £ > 0. 


□ 


4 Discussion and conclusions 


Choosing the most suitable inconsiste ncy index is of considerable importance, yet formal studies h ad not 
been undertaken until very recently (jBrunelli and Fedrizzil . l2015al : iKoczkodai and Szward . 120141 ) . This 
is in contrast with the existence of long-standing studies on other aspects of pairwise comparisons. One 
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of these is the choice of the method for deriving the priorit y vector, for which axiom atic studies have 
been propose d in the litera ture already in the Eighties (jCook and Kresa . Il988l : iFichtnerl. Il98(il) and in 
the N ineties ( Barzilai . 1997 1. Nevertheless, it has been shown by numerical studies d Is hi z a ka. and Lusti . 


2006) that, excepts for some particular cases, such differences can be negligible and that therefore, in 


most of the cases, choosing one method or another does not really influence the final outcome. 

In light of the recently proposed five properties for inconsistency indices, the contribution of this 
research is at least twofold: 


• Firstly, it introduces and justifies a sixth property (P6) and shows that, together with the other 
five, it forms an an independent and logically consistent set of properties. 

• Secondly, the paper further analyzes the satisfaction of the properties PI—P6. Four inconsistency 
indices have been considered from the literature and it was found that two of them fail to fully 
satisfy the set of properties P1-P6. A simple adjustment of one of these indices was proposed to 
make it fit P1-P6. 


Table [T] presents a summary of the findings ofThis research and shows how they expanded the original 
set of properties for inconsistency indices ([Brunelli and Fedrizzi. 2015a|). It is remarkable that, in the 
form in which they were originally introduced in the literature, the majority of the indices satisfy only 
some of them. This seems to indicate that the definition of the properties and the analysis of their 
satisfaction is not a mere theoretical exercise. 



PI 

P2 

P3 

P4 

P5 

P6 

Cl 

/ 

/ 

/ 

/ 

/ 

/ 

GW 

/ 

/ 

X 

— 

/ 

/ 

GCI 

/ 

/ 

/ 

/ 

/ 

/ 

RE 

/ 

/ 

/ 

X 

X 

/ 

Cl* 

/ 

/ 

/ 

/ 

/ 

/ 

HCI 

/ 

/ 

X 

/ 

/ 

/ 

NT 

/ 

/ 

— 

X 

/ 

/ 

K (Definition [T]) 

/ 

/ 

/ 

/ 

/ 

/ 

AI (Definition [2]) 

/ 

/ 

X 

/ 

/ 

/ 

CIh (Definition [2D 

/ 

/ 

/ 

/ 

/ 

/ 

CCI (Definition HD 

/ 

/ 

X 

— 

/ 

/ 


Table 1: Summary of propositions: /=property is satisfied, X=property is not satisfied, 

The_original results p rese nted in this research are separated from 

(Brunelli and Fedrizzi, 2015a) by the dashed lines. 


‘—’=unknown. 
previous ones 


The properties were here, and in previous research (Brunelli and Fedrizzi, 2015a), justified. Neverthe¬ 
less, clearly, this should not prevent anyone from criticizing and improving them: it is indeed desirable 
that a set of properties be openly discussed within a community. In this direction, if the system PI P6 
is considered too restrictive, it is worth noting that Theorem 1 implies that any subset of the properties 
P1-P6 also forms an independent and logically consistent set or properties (just a more relaxed one) 
which, indeed, can be used for the same purposes of P1-P6. In conclusion, it is the author’s belief that 
a systematic study of inconsistency and inconsistency indices may bring new insights and more formal 
order into the evergreen topic of rational decision making. Furthermore, in the future, it should be 
possible to extend the set of properties to other ty pes of numerical representations of preferences as, 
for instance, reciprocal preference relations (Tanino, 1984) and skew-symmetric additive representations 
(Fishburn, 1999). 
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Appendix: Proof of Theorem 1 

To prove logical consistency, it is sufficient to find an instance of / : A 
properties P1-P6. One such instance is the following function 


n —2 n —1 n 

ha) = E E E 

i —1 j=i +1 k=j+l 


^ik 


_|_ a ij a jk _ 2 


Q'ijQ'jk &ik 


which satisfies all the 


(14) 


To prove the independence of P1-P6, it is sufficient to find a function satisfying all prop ert ies exc ept one, 
for all the properties. The examples of inconsistency indices proposed by Brunelli and Fedr izzi (|2015al ) 
to prove the independence of the system P1-P5 are invariant under transposition. If follows that P1-P5 
are logically independent within the system P1-P6. It remains to show that P6 does not depend on 
P1-P5. Consider that, if A has one row, say H, whose non-diagonal elements are all greater than one, 
i.e. auj > 1 Vj 7 ^ H, then this property is shared by any matrix PAP 1 , where P is any permutation 
matrix, but not by its transpose A 1 . Taking into account the inconsistency index I* in (1141b and defining 
H as the row with the greatest non-diagonal element, then the function 


6(A) = /*(A) • ^1 + max |min{a#j — 1}, 0 


(15) 


M 


is invariant under row-column permutation but not under transposition. Hence, /-,6 satisfies AP but 
not P6. To prove the independence of P6, it remains to show that (11511 satisfies PI and P3-P5. It is 
easy, and thus omitted, to show that PI, P3, and P5 are satisfied. To prove it for P4, we note that any 
A G A* can be rewritten as 


A = 


/ 1 

ai2 

ai2a23 

• • • ai2 

• • • ^72—1 72 

1 

ai2 

1 

a23 

• • • 023 

• • • ^n—1 72 

i 

l 

i 


^72—1 72 

1 

ai2-...-a n -2n-l 

1 

(223 — 2 n — 1 

1 

CL34-...-a n -2n-l 

1 



& 12 ’ ...’CLn—1 r 




&34 ' • • 1 T 


G A* 


(16) 


Without loss of generality let us consider a\ n and its reciprocal a n \ and replace them with “in and °nl. 
respectively. Then, by calling A\ n the new matrix and bearing in mind that A G A*, we have 

r(Afj = £ (EE + ^ _ 2 


j —2 V a l j a jr. 


An 


/ n \ ( (®12 • • • ®n-l n) ®12 ■ ■ ■ ®n-ln „ | 

= (n — 2)-1-r- - 2 

\ a 12 • • • • • a n -ln (ai2 ■ ■ ■ ■ • Ctn-ln) / 

If H ^ {l,n}, then, in (11511 M is constant and P4 holds in this case. Also if H G {1, rz} and 
min j^ H {aHj} ^ aim then M is constant and P4 is satisfied. Finally, if H = 1 and min j^ H {anj} = am, 
it is 

^e(A? n ) = /*(Afj • (l + af n - l) = I*(A s ln ) • a( n (17) 
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which can be reduced to 


nMn) 


U(A s ln )=(n-2) 

=(n - 9i ( 


(ai2 * • • • • CLn-ln) . &12 * • • • * &n-l n C * "5 

1 - ~ ^ * V&12 * * * ^n—In) 


( 1\2 • • • &n— 1 ? 


(012•... • a n _i n ) 


-,25 

In 


=(n — 2) I ^ + oi„-2o' 


&ln 


In 


Considering that, from A G A* and H = 1, it follows that a\ n > 1 and the partial derivative in 5 is 


dUs (A 5 


In/ 


ds =( n - 2 ) ( 2 «ln 1 !og(oin) - 2af n log(oin)) 

= (n- 2) ^2a < |,“ 1 ^ (af n - a iri ) (logai„), 


>o 


which is always non-negative for 5 > 1 and non-positive for 0 < 5 < 1. Thus, P4 is satisfied and the 
properties P1-P6 are logically independent. 
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